tests: add grub tests for archlinux too by marmarek · Pull Request #682 · QubesOS/qubes-core-admin

marmarek · 2025-05-28T02:25:30Z

codecov · 2025-05-28T02:36:14Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.54%. Comparing base (e7d49e3) to head (1f94afd).
Report is 4 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #682      +/-   ##
==========================================
- Coverage   70.58%   70.54%   -0.04%     
==========================================
  Files          61       61              
  Lines       12973    12984      +11     
==========================================
+ Hits         9157     9160       +3     
- Misses       3816     3824       +8

Flag	Coverage Δ
unittests	`70.54% <ø> (-0.04%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

qubesos-bot · 2025-05-28T12:31:12Z

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025052914-4.3-archlinux&flavor=templates

Test run included the following:

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025031804-4.3&flavor=update

system_tests_whonix
- whonix_torbrowser: unnamed test (unknown)
- whonix_torbrowser: Failed (test died)
  # Test died: no candidate needle with tag(s) 'anon-whonix-tor-brows...
system_tests_audio
- TC_20_AudioVM_PipeWire_archlinux: test_250_audio_playback_audiovm_pipewire (failure)
  AssertionError: pacat for test-inst-vm1 (xid 11) running(False) in ...
- TC_20_AudioVM_PipeWire_archlinux: test_251_audio_playback_audiovm_pipewire_late_start (failure)
  AssertionError: pacat for test-inst-vm1 (xid 12) running(False) in ...
- TC_20_AudioVM_PipeWire_archlinux: test_260_audio_mic_enabled_switch_audiovm (failure)
  AssertionError: pacat for test-inst-vm1 (xid 14) running(False) in ...
- TC_20_AudioVM_Pulse_archlinux: test_252_audio_playback_audiovm_switch_hvm (failure)
  AssertionError: pacat for test-inst-vm1 (xid 27) running(False) in ...
system_tests_guivm_gui_interactive
- update_templates: Failed (test died)
  # Test died: command 'qvm-template upgrade --yes --enablerepo=qubes...
system_tests_gui_interactive
- clipboard_and_web: unnamed test (unknown)
- clipboard_and_web: Failed (test died)
  # Test died: no candidate needle with tag(s) 'text-editor-save-prom...

Failed tests

9 failures

system_tests_whonix
- whonix_torbrowser: unnamed test (unknown)
- whonix_torbrowser: Failed (test died)
  # Test died: no candidate needle with tag(s) 'anon-whonix-tor-brows...
system_tests_audio
- TC_20_AudioVM_PipeWire_archlinux: test_250_audio_playback_audiovm_pipewire (failure)
  AssertionError: pacat for test-inst-vm1 (xid 11) running(False) in ...
- TC_20_AudioVM_PipeWire_archlinux: test_251_audio_playback_audiovm_pipewire_late_start (failure)
  AssertionError: pacat for test-inst-vm1 (xid 12) running(False) in ...
- TC_20_AudioVM_PipeWire_archlinux: test_260_audio_mic_enabled_switch_audiovm (failure)
  AssertionError: pacat for test-inst-vm1 (xid 14) running(False) in ...
- TC_20_AudioVM_Pulse_archlinux: test_252_audio_playback_audiovm_switch_hvm (failure)
  AssertionError: pacat for test-inst-vm1 (xid 27) running(False) in ...
system_tests_guivm_gui_interactive
- update_templates: Failed (test died)
  # Test died: command 'qvm-template upgrade --yes --enablerepo=qubes...
system_tests_gui_interactive
- clipboard_and_web: unnamed test (unknown)
- clipboard_and_web: Failed (test died)
  # Test died: no candidate needle with tag(s) 'text-editor-save-prom...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/132953#dependencies

5 fixed

system_tests_basic_vm_qrexec_gui
- TC_20_NonAudio_whonix-gateway-17: test_300_bug_1028_gui_memory_pinning (failure)
  AssertionError: Dom0 window doesn't match VM window content, saved ...
system_tests_whonix
- whonixcheck: fail (unknown)
  Whonixcheck for sys-whonix failed...
- whonixcheck: unnamed test (unknown)
system_tests_audio
- TC_20_AudioVM_Pulse_whonix-workstation-17: test_252_audio_playback_audiovm_switch_hvm (failure)
  AssertionError: only silence detected, no useful audio data
system_tests_qrexec
- TC_00_Qrexec_fedora-41-xfce: test_081_qrexec_service_argument_allow_specific (error)
  subprocess.CalledProcessError: Command '/usr/lib/qubes/qrexec-clien...

Unstable tests

Details

system_tests_update
update2/Failed (1/5 times with errors)
- job 139051 # Test died: command 'script -c 'qubes-vm-update --force-update --l...

Performance Tests

Performance degradation:

No issues

Remaining performance tests:

No remaining performance tests

Test for QubesOS/qubes-linux-utils#124 Exclude pvgrub2 test, as Arch is also using zstd.

marmarek added the openqa-pending label May 28, 2025

marmarek force-pushed the test-arch-grub branch from e26503f to 288ea85 Compare May 28, 2025 08:51

marmarek force-pushed the test-arch-grub branch from 288ea85 to 7c679a4 Compare May 29, 2025 02:47

marmarek added the openqa-group-2 label May 29, 2025

This was referenced May 29, 2025

archlinux: include scrub_pages initrd hook QubesOS/qubes-linux-utils#126

Merged

tests: give it more time to start recording #683

Merged

marmarek force-pushed the test-arch-grub branch from 7c679a4 to 6aca18f Compare May 29, 2025 09:21

tests: add grub tests for archlinux too

1f94afd

Test for QubesOS/qubes-linux-utils#124 Exclude pvgrub2 test, as Arch is also using zstd.

marmarek force-pushed the test-arch-grub branch from 6aca18f to 1f94afd Compare May 29, 2025 13:58

qubesos-bot mentioned this pull request May 29, 2025

archlinux: restart qubes-qrexec-agent on update QubesOS/qubes-core-qrexec#209

Merged

marmarek merged commit 37e49a1 into QubesOS:main May 30, 2025
3 of 5 checks passed

marmarek deleted the test-arch-grub branch July 19, 2025 21:58

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

tests: add grub tests for archlinux too#682

tests: add grub tests for archlinux too#682
marmarek merged 1 commit intoQubesOS:mainfrom
marmarek:test-arch-grub

marmarek commented May 28, 2025

Uh oh!

codecov bot commented May 28, 2025 •

edited

Loading

Uh oh!

qubesos-bot commented May 28, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

marmarek commented May 28, 2025

Uh oh!

codecov bot commented May 28, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

qubesos-bot commented May 28, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

OpenQA test summary

New failures, excluding unstable

Failed tests

Fixed failures

Unstable tests

Performance Tests

Performance degradation:

Remaining performance tests:

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

codecov bot commented May 28, 2025 •

edited

Loading

qubesos-bot commented May 28, 2025 •

edited

Loading